AI Tool Could Change Language in Films
2021-05-24
LRC
TXT
大字
小字
滚动
全页
1A start-up company has a tool that it says can recreate lip sync - matching a speaker's lip movements with pre-recorded audio - in films.
2The artificial intelligence, or AI, tool may change how film producers replace recorded speech in a movie with speech recorded in another language.
3This process is known as dubbing.
4Start-up Flawless AI, co-founded by film director Scott Mann, has a tool that it says can recreate lip sync without changing the performance of the actors.
5The tool studies how actors move their mouths.
6It then changes the movements to sync with the replaced, or dubbed, words in different languages.
7The result could be that Tom Hanks looks like he can speak Japanese or Jack Nicholson looks like he can speak French.
8The idea for the tool came to Mann when he saw how dubbing affected his 2015 film "Heist," starring Robert De Niro.
9"I hate dubbing as it stands," Mann told Reuters.
10He went on to describe the problems that dubbing can create.
11"You have to change so many things to try and catch sync. You're changing words filmmakers and performers have thought about so deeply. They're thrown out to find a different word that fits, but it never really does."
12Mann decided to do something about this issue.
13After some research, he discovered a paper written by Christian Theobalt of the Max Planck Institute for Informatics in Germany.
14The paper lays out a new method that uses artificial intelligence to recreate human visual effects.
15The tool worked to translate a De Niro scene in "Heist."
16Man said the tool was able to take an 'ooh' sound from De Niro 20 minutes earlier and place that in a different moment in the film."
17He added, "It measures at the same time and blends it so that the performance is the same, but it's a different mouth movement."
18Blend is a term that means to mix something, often with good results.
19Flawless AI is now working with producers and studios to use the technology after filming is complete.
20The first films using this tool are around a year away.
21Mann believes this technology will help to remove foreign-language categories at award shows.
22It could create a more open film industry with a real global stage.
23"From a filmmaking point of view, you're going to see the rise of a much more diverse range of stars," he said.
24Eventually, Mann hopes the technology's use will be widely accepted.
25"When it's a common thing, we're not going to think about it anymore and we'll just enjoy the movies," he said.
26I'm John Russell.
1A start-up company has a tool that it says can recreate lip sync - matching a speaker's lip movements with pre-recorded audio - in films. 2The artificial intelligence, or AI, tool may change how film producers replace recorded speech in a movie with speech recorded in another language. This process is known as dubbing. 3Start-up Flawless AI, co-founded by film director Scott Mann, has a tool that it says can recreate lip sync without changing the performance of the actors. 4The tool studies how actors move their mouths. It then changes the movements to sync with the replaced, or dubbed, words in different languages. The result could be that Tom Hanks looks like he can speak Japanese or Jack Nicholson looks like he can speak French. 5The idea for the tool came to Mann when he saw how dubbing affected his 2015 film "Heist," starring Robert De Niro. 6"I hate dubbing as it stands," Mann told Reuters. He went on to describe the problems that dubbing can create. "You have to change so many things to try and catch sync. You're changing words filmmakers and performers have thought about so deeply. They're thrown out to find a different word that fits, but it never really does." 7Mann decided to do something about this issue. 8After some research, he discovered a paper written by Christian Theobalt of the Max Planck Institute for Informatics in Germany. 9The paper lays out a new method that uses artificial intelligence to recreate human visual effects. 10The tool worked to translate a De Niro scene in "Heist." Man said the tool was able to take an 'ooh' sound from De Niro 20 minutes earlier and place that in a different moment in the film." 11He added, "It measures at the same time and blends it so that the performance is the same, but it's a different mouth movement." 12Blend is a term that means to mix something, often with good results. 13Flawless AI is now working with producers and studios to use the technology after filming is complete. The first films using this tool are around a year away. 14Mann believes this technology will help to remove foreign-language categories at award shows. It could create a more open film industry with a real global stage. "From a filmmaking point of view, you're going to see the rise of a much more diverse range of stars," he said. 15Eventually, Mann hopes the technology's use will be widely accepted. "When it's a common thing, we're not going to think about it anymore and we'll just enjoy the movies," he said. 16I'm John Russell. 17Rollo Ross reported on this story for Reuters. John Russell adapted it for Learning English. Susan Shand was the editor. 18_____________________________________________________________ 19Words in This Story 20lip-sync - n. to pretend to sing (recorded words) 21translate - v. to change words from one language into another language 22scene - n. a part of a play, movie, story, etc., in which a particular action or activity occurs 23category - n. a group of people or things that are similar in some way 24diverse - adj. made up of people or things that are different from each other 25range - n. a group or collection of different things or people